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(54) Fingerprint matching 



(57) An image feature extractor (11) has a feature vector extraction means (102) for extracting a feature vector 
from a pattern image, a quality index extraction means (106) for extracting quality index information of the 
pattern image, an error distribution information storing means (105) wherein error distribution information 
representing correlation between error distribution of the feature vector and the quality index information is 
prepared, and a confidence attribution means (107) for obtaining confidence estimation information referring 
to the error distribution information retrieved with the quality index information. An image feature matching 
system identifies feature information of an image pattern extracted by the image feature extractor (11) by 
comparing it to registered feature information. 
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At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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IMAGE COLLATING SYSTEM - ' . 

The present invention relates to an image collating system, 
and to an image feature extractor for extracting 

image features of a pattern image such as a skin pattern image 
represented by a fingerprint or a palm-print, an image feature analyzer 
for analyzing the image features, and an image matching system for 
verifying matching of the pattern image with those filed in a database. 

In the following description, the present invention is explained in 
connection with a skin pattern feature extractor, a skin pattern feature 
analyzer and a skin pattern matching system applied to personal iden- 
tification as representative examples of the above devices. However, 
it will be easily understood that the present invention can be widely 
applied to matching verification of other pattern linages having certain features, 

and is not limited to the skin pattern matching verif icafeior. . 

As a most orthodox art for identifying a skin pattern such as 
a fingerprint or a palm-print, there is known a matching verification 
method making use of feature points of the fingerprint called the minu- 
tia matching which is disclosed in a Japanese Patent entitled "Fin- 
gerprint Collation System" published as a specification No. 63-34508. 

However, a disadvantage of the minutia matching is that it takes a lot of 
computational time because of a large amount of data th be processed. 
Ore mstied proposed to overcame the aforesaid disadvantage is a technics fcr reducing 

a number of candidates to be verified by way of the Ten Print Card, 
which is disclosed in "Fingerprint Card Classification for Identification 
with a Large-Size Database" by Uchida, et .ttT.\ Technical Report of 
IEICE (The Institute of Electronics, Information and Communication 



Engineers) PRU95-201 (Jan. 1996). In the Fingerprint Classification 
of this technique, a high-speed rough matching is performed referring 
to certain features such as the basic fingerprint classification category, 
distances between singular points, namely, cores or deltas, etc., for pre- 
selecting candidates to be verified with the minutia matching. As the 
basic fingerprint classification categories, the fingerprint pattern of each 
finger is classified into a basic category, such as the 
Whorl, the Right Loop, the Left Loop or the Arch, and the number of 
ridge lines and the distances between cores and deltas of each finger 

are extracted together with their confidence -values, 

and used in the rough matching technique. 
The arount of data associated with these features is at most several hundred bytes 

for a card, far smaller than the several thousand bytes necessary for 

the minutia matching. The smaller data amount, and consequently the 

smaller calculation amount enable a high-speed fingerprint verification. 
Thus by reducing the nunfcer of candidates before the minutia matching is performed, 

the pre-selection technique of the prior document by Uchida et al. 

enables the total cost performance of the fingerprint verification 

system as a whole to be improved. 

However, because the deltas are usually found in edge parts of 
the fingerprint, the numbers of ridge lines and the distances between a 
core and a delta are often difficult to be extracted when a so called roll 
printing is not performed correctly. The roll printing means here to 
take the fingerprint pattern by pressing a fingertip rolling on a card, as 
usually performed when the police take the fingerprint. Furthermore, 
the above technique is not efficient to pre-select the Arch patterns 
which have no delta. 
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Therefore, methods for improving pre-selection performance have 
been sought. One promising solution is to find other appropriate fea- 
tures to be used for the rough matching in place of or in addition to the 
above features. One of the possible features is the direction pattern of 
fingerprint ridge lines. "Personal Verification System with High Toler- 
ance of Poor Quality Fingerprints" by Sasagawa et'al., the transactions 
of IEICE D-II* Vol. J72-D-II, No. 5, pp. 707-714, 1989, is an example 
of usage of the direction pattern to the rough matching. 

Features with many dimensions ; such as the direction pattern 

of the fingerprint ridge lines, makes . the high- 

speed matching verification difficult. Therefore, when evaluating such features, 

it is necessary to find a feature extraction method enabling to 

extract a condensed feature function or value having an appropriate dimension 

size giving good results and sufficient efficiency at the same 
time. A well-known method of such a feature extraction is the prin- 
cipal component analysis. An example of the method applied to the 
direction pattern of the fingerprint ridge lines is described in a paper of 
C. L. Wilson et al., entitled "Massively Parallel Neural Network Fin- 
gerprint Classification System", NISTIR4880, 1992, Jul, published by 
National Institute of Standards and Technology. 

In the method of C. L. Wilson et al., the direction pattern is 

processed as follows. 

First, training data of N fingerprint images are prepared. Then, 
defining feature vectors composed of ridge directions each representing 
local flow of ridge lines, the principal component analysis is performed 
for distribution of the feature vectors to obtain principal component 
vectors having larger eigenvalues. Using the principal component vec- 
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tors thus obtained, Karhunen Loeve Transform (hereafter abbreviated 
as KLT) of the feature vector of an objective fingerprint image is per- 
formed, whereof feature values of upper dimensions are extracted as 
the condensed feature value. 

In the following paragraphs, more details of the feature extraction 

using the KLT are described. 

For the first, a variance-covariance matrix V is calculated as fol- 
lows from feature vectors u< (i = 1 to N) of the N fingerprint images 
prepared for the training. 

V = ^r^-r ECtx,- - u){ui - u) 1 (!) 

- 1 £ ' (2) 

u = — > u, v J 

N ~1 . 

Here, the feature vectors u { are column vectors of M dimensions, 

H is a mean vector of u it and the upper suffix 1 means a transpose. 

Eigenvalues of the variance-covariance matrix V being represented 
15 by A . ( - = 1,' . . . , M\ Xi > A i+l ), eigenvectors corresponding to the 
eigenvalues A, are represented by 0> t , These eigenvectors are the 
principal component vectors and one corresponding to a largest eigen- 
value Ai is called a first principal component vector, followed by a 
second, a third, a M-th principal component vector in the order 
of corresponding eigenvalue. 

For a feature vector u of an objective fingerprint image, which is 
not used for the training, projection of the feature vector u to a partial 
space defined by one or more primary (corresponding to largest eigen- 
values) principal component vectors tf- is calculated, that is, projection 
25 components v { around the mean vector u are obtained as follows: 

Vi = #\(u-V). ( 3 ) 
The projection components Vi thus obtained are the feature values 



20 



extracted by way of the KLT. 

In C. L. Wilson et al., a feature vector composed, as its com- 
ponents, of primary projection components v t - corresponding to the 
primary principal component vectors is input to a neural network for 
the fingerprint classification. However, these extracted feature values 
are used only for the classification and any application to the matching 
verification is not taught therein. 

Although it is not applied to the skin pattern analysis, there is de- 
scribed an example of a facial image matching verification making use 
of feature values obtained by the KLT, in "Eigenfaces for Recognition" 
by A. Pentland et .al., MIT Media Lab Vision and Modeling Group, 
Technical Report #154 and also in "Probabilistic Visual Learning for 
Object Detection" by B. Moghaddam and A. Pentland, pp. 786-793 of 
Proceedings of the 5-th International Conference on Computer Vision, 
1995. In these two documents, a method of facial image matching ver- 
ification is described, wherein a vector consisting of each pixel value of 
a facial image as each component thereof is used as the source feature 
vector, and the facial matching verification is performed according to 
Euclidean distance or Mahalanobis distance of the condensed feature 
vector extracted by way of the KLM of the source feature vector. 

However, these prior arts have their . disadvantages when applied to the 
fingerprint matching verification. 

By Uchida et al., it is often difficult to extract sufficient features 
such as distances or numbers of ridge lines between the core and the 
delta when the rotation stamping is not performed correctly because 
the deltas are usually found in edge parts of the fingerprint. Fur- 
thermore, the Arch patterns having no delta cannot be pre-selected 
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sufficiently. 

In C..L. Wilson et al., there is a description concerning finger- 
print feature extraction making use of the KLT applied to fingerprint 
classification, but no description concerning application thereof to the 
5 fingerprint matching verification is used, for exarple, to pre-select the 

verification candidates, as intended in Uchida et al. 

Although not to the fingerprint matching verification, application 
of the KLT to facial image matching verification is disclosed in the doc- 
uments of A. Pentland et al. The fingerprint image may be processed 

10 according to Euclidean distances or Mahalanobis distances in the same, 
way with the above method of A. Pentland et al. However, many of, 
the available fingerprint images are of fairly low grade and sufficient; 
reliability cannot be expected with such a simple method as that of 
A. Pentland et al., relying simply upon the condensed feature vector. 

15 The reason is that necessary consideration is not paid to confidence of 
the extracted -features there. 

It is the same with Uchida et al., wherein the distance between 
pattern images is defined with a feature value and a confidence value. 
However, the confidence value is calculated heuristically and there is 

20 given no logical evidence. 

Therefore, a primary object of the present invention is to embody 
a matching verification architecture for efficiently identifying pattern 
images such as skin patterns by resolving the above problems, and 
to provide an image feature extractor, an image feature analyzer and 

25 an image matching system, wherein a high-speed and a high-precision 
processing is realized. 

. First, the principle of the invention will be explained. 
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When two feature vectors are given, a variety of distances can 
be defined between the two feature vectors. As examples thereof, fol- 
lowing Euclidean distance, weighted Euclidean distance, Mahalanobis 
distance, etc., are introduced in pp. 652-658 of "Handbook of Image 
Analysis" by Takagi et al., Tokyo Universi ty Press, 199 1. 
Euclidean distance y) = 



\ 



£(*,• - Vi) 2 (4) 
1=1 



weighted Euclidean distance D(x,y) ^,Wi(Xi — 7/ t -) 2 (5) 

Mahalanobis distance D(x,y) = yj (x — yj'V^X — y) (6) 
10 where, X{ and t/ z - are respective components of the two feature vectors x 
and y both having n dimensions, W{ is a corresponding weight factor, 
and V is a variance-covariance vector of distribution of the feature 
vectors. 

Among them, the Mahalanobis distance is known to give a most 
!5 natural distance when the feature vectors accord to normal- distribu- 
tion. 

When the two feature vectors x and y axe vectors obtained by 
the KLT, above equation (6) can be represented as follows, which is 
described also i n the documen ts of A. Pentlandet al 
20 D(x,y) = 



,t^^ (7) 

where, A t - are eigenvalues of the variance-covariance vector V\ A set of 



eigenvalues A x - is defined for a distribution of whole feature vectors or 
for each of distributions of respective classes of the feature vectors. 
As shown by above equation (7), the Mahalanobis distance of the 
25 feature vectors obtained by the KLT needs no matrix operation. It 
can be calculated with a simple square sum operation compatible to 
equation (5), enabling to reduce computational time. 
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Suppose, here, to classify the feature vectors into classes C{Q) 
according to their feature values Q, the feature values Q (hereafter 
called the quality indexes) being values having correlation with errors 
of respective feature vectors. To clarify relation between the quality in- 

5 dex and the distance used for discriminating a feature vector, different 
condensed feature vectors, obtained from a specific object image and 
having their respective quality indexes Q, are considered. Assuming 
these condensed feature vectors have been processed through the KLT 
making use of variance-covariance matrix of distribution of source fea- 

10 ture vectors, and representing variance among i-th components of the 
condensed feature vectors classified into each class C{Q) by X { C{Q), 
the Mahalanobis distance between two condensed feature vectors x and 
y belonging to a specific class C'(Q) is expressed as follows: 



A (*» ~ I/O 2 (8) 

15 "Here, \i(C(Q)) gives an error variance among the feature vectors 
since it is a variance of distribution of the feature vectors obtained from 
the same specific object image, provided that the distribution of the 
feature vectors of the class C(Q) accords to a normal distribution and 
the eigenvector of the variance-covariance matrix of distribution of the 

20 class C(Q) is the same with the eigenvector of the variance-covariance 
matrix applied to the KLM. 

Now, a case is considered wherein the quality index Q and the 
error variance A t (C(Q)) have a correlation expressing that the better 
quality index makes the smaller the error variance as illustrated in 

25 FIG. 22 (wherein the correlation is represented by that of an i-th di- 
mension), and two different feature vectors x and y t whereof a distance 
is calculated, have a common quality index. 
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Representing the common quality index by l Q of FIG. 22 and 
corresponding error variance by l A,-, a distance D\{x, y) between the 
two feature vecto rs is calculate d as follows: 



± ^T^, (9) 



while another distance D2(x,y) between the same feature vectors x 
and y is calculated as follows when they have another common quality 
index 2 Q: 



E (a? 'o/° 2 . (10) 

x'=l ~ A i 



Here, it is noted that a relation Di(x,y) < Di{x,y) stands when 
the error variance of each z-th dimension has a relation L A X > 2 A{. It 
means that the Mahalanobis distance varies adaptively to the quality 
index so as to give a small distance difference estimation when having 
a poor quality index, that is, giving large error variances l A t -, and a 
large distance difference estimation when having a good quality index 
to the same two feature vectors x and y } Euclidean distance thereof 
being constant. 

The fact that the distance varies adaptively to the quality index is 
significant, since thereby incorrect rejection because of data extracted 
from low grade images can be effectively reduced. 

In Uchida «t al., beforehand described, precision of feature ex- 
traction is reflected to a distance value by defining the distance value 
according to the confidence value (which is heuristically calculated as a 
value reflecting the feature extraction precision). However, the distance 
value is defined by a product of the confidence value and a difference 
between two feature values each belonging to each entirely different di- 
mension, which can be said to be the same thing to define the distance 
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value by multiplying the height with the weight. Therefore, there is 
no statistical or theoretical guarantee of precision improvement, even 
if some good results may be obtained. 

On the other hand, by converting the quality index (which can be 
5 said to be the confidence) into each error variance among components 
of respective dimension of the feature vectors as above described, a 
measure of distances having the same dimensions with the feature vec- 
tors can be defined. The Mahalanobis distance is one of the distances 
which can be defined with statistical support, although there are some 
10 restrictions such as the assumption of the normal distribution. 

A good discrimination performance can be thus obtained by defin- 
ing a distance value supported statistically. 

Heretofore, a distance between two different feature vectors is de- 
"scribed. This is to explain a fact that a strict value of the Mahalanobis 
15 distance, which luus a statistical" significance, can be obtained concern- 
ing feature vectors of a specific object, by assuming a normal distribu- 
tion of the feature vectors. However, the essential merit of the above 
quality index does not lie in defining the strict Mahalanobis distance 
itself, but in reflecting correlation between the quality index shown 
2 0 in FIG. 22 and the error distribution of the feature vectors onto the 
distance definition. 

The Mahalanobis distance, which is adaptive to the above quality 
index, can be obtained by calculating error distributions of different 
feature vectors in each class obtained from a specific object and sorting 
25 them according to their quality index. However, calculation of such 
values is applicable only to such a special matching verification wherein 
few objects are treated and only confirmation of identity thereof is 



discussed. 

For specifying an unknown object, such, as intended in the remain- 
ing fingerprint verification performed in the criminal investigation, the 
above distance-; definition is inapplicable. A distance between feature 
5 vectors obtained from different objects should be defined, too. 

For the purpose, a distance value which will be described in the 
following paragraphs can be defined, for example. 

A most significant object of the distance definition is to reflect a 
quality index, or a confidence, to the error distribution. Hence, follow- 
10 ing three assumptions 1. to 3. are applied to the distance definition. 

1. The errors included in a feature vector are dependent on its 
quality index and independent of the feature vector itself. 

2. A distribution of the errors Jncluded in feature vectors accords 
to a normal distribution. 

3. Errors corresponding to a difference between two feature vectors 
can be estimated from the errors included in each of the two feature 
vectors. 

On the three assumptions, a Mahalanobis-like distance function 
D{x,y) is defined as follows 
D{x,y) = 



15 
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f (*»• - y*) 2 (ii) 

Wi A, 

A; = *A t + *A,- (12) 
Here, X A ; and y A t - are variances of the error distributions, depend- 
ing on the quality index, of components i,- and iji of the respective 
feature vectors x and y, and A; represents an estimation of errors cor- 
25 responding to x- t - yi. The error variances X A; and y \i can be prepared 
through an examination of respective inter-relations such. as illustrated 
in FIG. 22. 
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Further, the ordinary Mahalanobis distance is said to have a prob- 
lem that its discrimination performance is degraded in a range where 
eigenvalues (A,-) are small because its susceptibility to noises (for exam- 
ple, in "A Handwritten Character Recognition System Using Modified 
Mahalanobis Distance" by Kato et al., the transactions of IEICE D- 
II, Vol. .T79-D-II, No. 1, pp. 45-52, 1996). Therefore, the distance 
function may be defined by way of following function. 

!>(*, ,) = -± log SIM (13) 



20 



,-=i p{dm 

di = 



\, = *A.- + »A £ ( 15 >. 

Here, o: represents a set of differences among feature vectors ob- 
tained from a specific pattern, and P(d { \ix) represents a distribution of 
the differences in the set, .namely, the error distribution. On the other 
hand, (3 is a set of differences among feature vectors obtained from 
whole patterns, and P(di\(3) is a distribution of the differences among 
feature vectors therein. 

When the distribution functions P(di\a) and P(di\P) accord to 
the normal distribution, they are calculated as follows, firstly. 

™ = 7^-bi) (16) 



PWP) = /, v. ex P 



where A £/ , and X iJ} are variances of respective distribution functions 
P(di\a) and 

Then, from these distribution functions, the distance function of 
25 the equation (13) can be developed as follows. 

£>(*. y) = t it. (t- T~] 4 + ±0»S - 10 6 ( 18) 

v 2 i =l \A,- i0 Kfij i=\ 
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Therefore, a Mahalanobis-like distance function such as defined 
by equation (11) can be composed by obtaining square root, of the first 
term in the right side of equation (19). Difference between the two dis- 
tance functions is that a weight factor ( ^ — jjj) is attributed to each 
dimension of the feature vector, in the equation (19). The weight factor 
is determined according to the error distribution relative to the distri- 
bution of the whole patterns. When the error distribution is sufficiently 
small compared to the whole pattern distribution, the weight factor 
becomes large, attaching much importance to corresponding dimen- 
sion. On the contrary, the error distribution is equivalent to the whole 
pattern distribution, the weight, factor becomes small, corresponding 
dimension being relatively neglected in effect. Thus, an effective result 
can he obtained with the distance function of equation (19) even from 
feature vectors including components giving small eigenvalues A;, that 
is, susceptible to noises. 

Heretofore, the principle of the invention whereon the embodi- 
ments are based is described mainly in connection with feature values 
obtained through the KLT. This is to clarify statistically and theo- 
retically tte effectiveness of the invention, wherein an error distribution is 
obtained according to the quality index and reflecting the matching 
verification. 

However, application of this invention is not necessarily limited to 
the feature values processed by the KLT. The most important essence 

of the invention lies in providing an- architecture which enables matching verification 

between two image patterns talcing in consideration of their 
confidence, referring to errors of feature values, the errors being adap- 
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tively measured according to quality index of the image pattern. 

In <rider to embody the matching verification architecture based 
on the above principle, an image feature extractor of the invention, for 
outputting a feature information data set of a pattern image including 
5 dat-a of a feature vector of the pattern image and confidence estimation 
information of the feature vector attributed to each component, of the 
feature vector, comprises; 

a feature vector extraction means for extracting the feature vector 

from the pattern image; 
10 a quality index extraction means for extracting quality index in- 

formation of the pattern image; 

an error distribution information storing means wherein error dis- 
tribution information is prepared, the error distribution information 
representing correlation between error distribution of a plurality of fea- 
15 ture vectors extracted by the feature vector extraction means and the 
quality index information extracted from the quality index extraction 
means corresponding to the plurality of feature vectors; and 

a confidence attribution means for obtaining confidence estimation 
information referring to the error distribution information prepared in 
20 ' the error distribution information storing means by way of the quality 
index information extracted from the pattern image by the quality 
index extraction means. 

An image feature analyzer of the invention, for obtaining the er- 
ror distribution information to be prepared in the error distribution 
25 information storing means of the image feature extractor, comprises: 
a feature vector extraction means for extracting the plurality of 
feature vectors from pattern images; 
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a quality index extraction means for extracting the quality index information from 
the pattern images; and 

a error distribution information analyzing means for calculating the error 
distribution information from distribution among each feature vector set of the plurality 
of feature vectors and a value of the quality index information of each feature vector 
belonging to the each feature vector set, said each feature vector set comprising feature 
vectors extracted more than one pattern images of a same pattern. 

An image feature collating system of the invention for determining the extent of 
ectypography between pattern images making use of the feature information data set of 
the pattern image comprises: 

a database section wherein the feature information data set of each of a plurality 
of pattern images is registered; and 

a matching section for preforming matching verification of the pattern image by 
discriminating accordance/discordance of the feature information data set registered in the 
database section according to distance between two feature vectors each included in 
respective feature information data set calculated in consideration of the confidence 
information of the two feature vectors. 

A system for collating images according to another aspect of the invention 
comprises means for deriving a feature value for the features of each image; means for 
deriving a quality index value for the features of each image; means for determining 
errors for the feature values in which said errors are adaptively measured according to 
the quality index of the features of each image; and means for determining the extent of 
ectypography between features of each image. 

In a further aspect, the invention provides a method for collating images 
comprising the steps of determining feature values for image features; deriving quality 
index values for image features; determining the extent of ectypography between each 
image by considering the confidence between the features of each image and referring to 
the errors for the feature values for the two images wherein said errors are adaptively 
measured according to the quality index of the features of the images. 

Therefore, a high-speed and a high-precision method of determining the degree 
of ectypography between image features can be realized by the image collating system 
of the invention. 

The foregoing, further objects, features, and advantages of this invention will 
become apparent from a consideration of the accompanying drawings by way of example 
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In -the drawings:. 

FIG. 1 is a block diagram illustration a first embodiment of the 
skin pattern matching system according to the present invention; 

FIG. 2 is a pattern chart illustrating an example of a set of the 

5 

ridge directions; 

FIG. 3 is a block diagram illustrating a configuration of the quality 
index extraction means 106 according to the example for obtaining the 
quality index from the confidence of ridge direction; 
10 FIG. 4 is a schematic diagram illustrating data table prepared in 

the error distribution information storing means 105; 

FIG. 5 is a block diagram illustrating a first embodiment of the 
skin pattern feature analyzer according to the invention; 

FIG. G is a flowchart illustrating processes performed in the skin 
15 pattern feature analyzer 51 of FIG. 5; 

FIG. 7 is a graphic chart illustrating an analysis result of the skin 
pattern feature analyzer of FIG. 5; 

FIG. 8 is a schematic diagram illustrating a feaUire vector X, 
originally to be in the closed space Q when there is no noise, extracted 
20 as another feature vector O; 

FIG. 9 is a block diagram illustrating a quality index extraction 
means 90 according to the second embodiments; 

FIG. 10 is a flowchart illustrating processes performed in the qual- 
ity index extraction means 90 of FIG. 9; 

FIG. 11 is a schematic diagram illustrating 1- dimensional error 

25 

distribution table applied to the second embodiments; 

FIG. 12 is a graphic chart illustrating an experimental result of 



the error distribution table of FIG. 11; 

FIG! 13 is a block diagram illustrating a configuration of the qual- 
ity index extraction means 130 according to the third embodiments; 

FIG. 14 is a flowchart illustrating processes performed in the qual- 
ity index extraction means 130 of FIG. 13; 

FIG. 15 is a block diagram illustrating the fourth embodiment of 
the skin pattern matching system of the invention; 

FIG. 16 is a schematic diagram for explaining principle of the fifth ^ 
embodiment; 

FIG. 17 is a block diagram illustrating a feature vector extraction 
means of the fifth embodiment; 

FIG. 18 is a schematic diagram illustrating sampling operation of 

of the sampling means 1704 of FIG. 17; 

FIG. 19 is a block diagram illustrating a basic configuration of the 
sixth embodiment of the skin pattern matching system; 

FIG. 20 is a block diagram of a fourth embodiment of the skin 
pattern feature analyzer of the invention; 

FIG. 21 is a schematic diagram illustrating a palm pattern; and 

FIG. 22 is a schematic diagram illustrating inter-relation between 

error variance and quality index. 

Now, embodiments of the present invention are described in con- 
nection with the drawings. The description will be made in connection 
with a skin pattern feature extractor, a skin pattern feature analyzer 
and a skin pattern matching system applied to personal identifica- 
tion as representative examples of the embodiments, namely, an image 
feature extractor, an image' feature analyzer and an image matching 
system, as previously premised. 



In the following paragraphs some embodiments of the skin pattern 
matching system and the skin pattern feature analyzer are described. 
As to the skin pattern extractor, it is described as a section, a feature 
extraction section, of the skin pattern matching system, since the skin 
pattern feature extractor is to be used as an element of the skin pattern 
matching system. 

FIG. 1 is a block diagram illustration a first embodiment of the 
skin pattern matching system according to the present invention. 

Referring to FIG. 1, the skin pattern matching system of the first 
embodiment has a feature extraction section 11 for extracting feature 
data from a skin pattern image, a database section 12 for managing a 
database storing the feature data extracted by the feature extraction 
section 11, a matching section 13 for performing matching verification 
of feature data extracted by the feature extraction 11 of an image to 
feature data registered in the database section 12, and a control section 
14 for controlling each element, of the skin pattern matching system. 
(Here, in the drawings, control lines connecting the control section 
14 with each element is not depicted for simplification.) The feature 
extraction section 11 corresponds to the skin pattern feature extractor 
to be claimed. 

The feature extraction section 11 comprises; 

an image input means 101 where image data of a skin pattern such 
as a fingerprint or a palm print are input, 

a feature vector extraction means 102 for extracting a feature vec- 
tor from image data input through the image input means 101, 

a vector transfer means 103 for generating feature information by 
performing the KLT of the feature vector extracted by the feature 



- 19 - 

vector extraction means 102, 

a principal component vector storing means 104 wherein princi- 
ple component vectors corresponding to feature values of the feature 
vectors are prepared to be used for the KLM performed in the vector 
; transfer means 103, 

an error distribution information storing means 105 wherein is pre- 
pared error distribution information representing correlation between 
the feature values and quality indexes, 

a quality index extraction means 106 for extracting a quality index 
L0 of the image data input through the image input means 101, and 

a confidence attribution means 107 for attributing confidence in- 
formation to the feature information generated by the vector transfer 
_ means 103 according to the quality index extracted by the quality in- 
dex extraction means 106 referring to the error distribution information 
l5 prepared in the error distribution information storing means 105. 

The feature information generated by the vector transfer means 
103 and the confidence information attributed thereto by the confi- 
dence attribution means 107 are the feature data extracted of the image 
data to be output from the feature extraction section 11. 
20 The. database section 12 comprises; 

a data storing means 109 wherein a plurality of feature data sets 
extracted by the feature extraction section 11 are registered, and 

a database management means 108 taking charge of reference or 
registration of the plurality of feature data sets in the data storing 
25 means 109. 

The matching section 13, which performs the skin pattern match- 
ing verification for outputting matching results, comprises; 
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a similarity calculation means 110 for calculating a similarity of 
the feature data supplied from the feature extraction means 11 to each 
of the plurality of feature data sets registered in the database section 
12, and 

5 a determination means 111 for determining accordance/discor- 

dance from the similarity calculated by the similarity calculation means 
110. 

Now, operation of the skin pattern matching system of FIG. 1 is 
described along with an example wherein the skin pattern matching 
10 system is applied to a fingerprint matching verification. 

First, procedure in the feature extraction section 11 is described. 
The image input means 101 obtains digital 2-dimensional image 
data of a fingerprint pattern by way of a scanner, a CCD (Charge 
Coupled Device) camera or the like. It may be configured to obtain 
15 the fingerprint image data through a public network from a remote 
terminal. Here, the fingerprint image data are assumed to be image 
data having 512 x 512 binaxy pixels taken with a resolution of 500 DPI 
(Dots Par Inch). 

The feature vector extraction means 102 extracts a feature vector 
20 from the fingerprint image data input through the image input means 
101. There can be considered various features to be extracted for the 
feature vector, beginning with the ridge direction, the ridge line pitch 
and so on. In this example, focusing on the ridge direction feature, the 
feature vector is described to be extracted making use of an "Apparatus 
25 for determining ridge line direction patterns" disclosed in a Japanese 
patent application laid open as a Provisional Publication No. 7097/'96. 
Here, the fingerprint image data input by the image input means 



101 are represented as /(*,»). * «""> » bBin S horizontal and vertical 
coordinates thereof having integer values from 1 to 512. With the 
apparatus of the Provisional Publication No. 7097/'96, a ridge direction 
8(C) having a value 0 < 6(C) < * can be extracted for each sub-region 
C defined in the image data /(*,»). In an example, 256 sub-regions C 
IC = 1, 2, . . ., 256) are defined horizontally and vertically at every 32 
pixels in a set of image data of 512 x 512 pixels. 

FIG. 2 is a pattern chart illustrating an example of a set of the „ 
ridge directions thus extracted, wherein the ridge direction and its 
ia confidence of each sub-region are represented by direction and length 
of each corresponding segment, respectively. When the ridge directum 
is expressed by such an angle value from 0 to , as in the Provisional 
Publication No- 7C>97/'95, a discontinuity arises between 8 -r and 
8 = 0. which is inconvenient for the feature vector. Therefore, the 
15 ridge direction 9(C) is converted into vector components «,(C) and 

«„(C) according to following equations. 
" (20) 
„„(C) = cos(2fl(C)) 

(21) 

«„(C) = sin(20(C)) 

Thus a following feature vector u having 512 dimensions cons.st- 
20 ing of the vector components u,(C) and u„(C) of every sub-region C 
is output from the feature vector extraction means 102 of FIG. 1. 



25 
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u = 



( «,(!> \ 
««(2) 

« x (256) 
«»(2) 



(22) 



25 



\«j,(256)/ 

The vector transfer means 103 performs the KLM of the feature 
vector u extracted by the feature vector extraction means 102 accord- 
ing to principal component vectors prepared in the principal compo- 
nent vector storing means 104. As for the principal component vectors, 
outputs of a first embodiment (which will be described afterwards) of 
the skin pattern feature analyzer may be prepared in the principal com- 
ponent vector storing means 104, for example. Here, consider there are 
prepared L principal component vectors (i = 1, 2, . . ., L) . Each of 
the principal component vectors &i has the same dimensions with the 
feature vectors u and expressed as a column vector. 

The vector transfer means 103 calculates, the KLT of the fea- 
ture vector u for each i-th of the L principal component vectors «P\ 
according to following equation from the feature vector u and the prin- 
cipal component vector IP,-. 

Vi = &iU . ( 23 ) 

Thus, a following condensed feature vector v is obtained from the 
source feature vector u through the KLT. 
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V 2 



V = 



(24) 



As will be described in connection to the first embodiment of the 
skin pattern feature analyzer, sufficient precision can be attained with 
a small number (five, for example) of principal component vectors, 
which defines the dimension number L of the condensed feature vector. 
The condensed feature vectors of five dimensions enables to reduce 
data amount into about 1/100 of the source feature vector having 512 
dimensions of ridge direction features. 

In case where a mean vector u is already prepared by calculating- 
mean value of the plurality of sample feature vectors u, the previous 
described equation (3) may be applied instead of above equation (23) 
for performing the KLT of the source feature vector u. 

The quality index extraction means 106 extracts the quality index 
through following procedure. 

The quality index may be represented by any data, provided that 
the data have correlation with errors included in the feature vector 
u. Here, calculation of the quality index making use of the confidence 
value discussed also in. the prior apparatus of the Provisional Publica- 
tion No. 7097/'96 is described by way of example, which is obtained 
along with determining the ridge direction. 

FIG. 3 is a block diagram illustrating a configuration of the quality 
index extraction means 106 according to the example for obtaining the 
quality index from the confidence of ridge direction. 

The quality index extraction means 106 comprises a ridge direc- 
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tion confidence extraction means 301 for extracting the ridge direction 
confidence from input image data 31, a second principal component 
vector storing means 302 for storing principal component vectors, and 
a data conversion means 303 for generating quality index data 32 from 

5 the ridge direction confidence extracted by the ridge direction confi- 
dence extraction means 301 and the principal component vectors stored 
in the principal component vector storing means 302. 

The ridge direction confidence extraction means 301 calculates 
a confidence value q{C) of ridge direction 0(C) of each s\ib-region, 

10 making use of eigenvalues of variance-covariance matrix of a. gradient 
vector of concerning sub-region C in the same way as disclosed in 
the Provisional Publication No. 7079/'96. As beforehand premised, 
the quality index may be calculated in another way, and complicated 
description is omitted, here. Furthermore, the prior apparatus of the 

15 Provisional Publication No. 7079/'96 outputs the confidence value q{C) 
together with the ridge direction Q(C). Therefore, the feature vector 
extraction means 102 of FIG. 1 may be included in the ridge direction 
confidence extraction means 301. 

In the second principal component vector storing means 302, the 

20 same L principal component vectors with those stored in the principal 
component vector storing means 104 are prepared. Hence, the principal 
component vector storing means 104 in the feature extraction section 
11 may be commonly referred to by the data conversion means 303 
instead of the second principal component vector storing means 302. 

25 The data conversion means 303 calculates quality index values Qi 

from the confidence value q{C) and the principal component vectors 
\&i according to following equation. 
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Qi = ^q{CY*i{CY (25) 

Here/\[';(C) represents C-th component of i-th principal compo- 
nent vector \P{. 

Thus, L quality index values Qi corresponding to L principal com- 
ponent vectors are calculated for a set of image data 31. As the 
quality index data 32, the data conversion means 106 outputs a follow- 
ing quality vector Q consisting of the L quality index values Qi as its 



components. 

{QA 



Q-2 



Q = 



(26) 



In the error distribution information storing means 105, error dis- 
tribution information, which is also calculated by the first embodiment, 
for example, of the skin pattern feature analyzer to be described af- 
15 terwards, is prepared. In the first embodiment, a standard deviation 
a(vi\ Qi) of each component v { of a condensed feature vector v is cal- 
culated when a corresponding component Q, of the quality vector Q, 
corresponding to the condensed feature vector v, is given. 

FIG. 4 is a schematic diagram illustrating data table prepared in 
the error distribution information storing means 105. 

Referring to the data table in the error distribution information 
storing means 105, the confidence attribution means 107 outputs a 
following confidence vector a by calculating a standard deviation value 
corresponding to the quality vector Q supplied from the quality index 
extraction means 106. For example, when a first component Q\ of the 
quality vector Q has a value in a range a; < Qi < Qr-2, tne data table 
of FIG. 4 is retrieved and a standard deviation value cxi.o is output. 
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In the same way, a certain standard deviation value, denoted by cr,-, is 

output for. every quality component Qi. Thus, a following confidence 

vector cr is obtained from the confidence attribution means 107. 
( cr x \ 



cr = 



^•2 



(27) 



Secondly, procedure performed in the database section 12 is de- 
scribed. 

The database section 12 takes charge of data recording controlled 
10 by the control section 14 or data reading to be delivered to the matching 
section 13 upon referring request. 

Controlled by the control section 14, the database management 
means 108_registers the feature vector v and corresponding confidence 
vector cr in the data storing means 109 together with data management 
15 information thereof such as data ID (IDentifi cation). 

As for the data storing means 109, a semiconductor memory such 
as a DRAM (Dynamic Random Access Memory) and data recording 
media such as a hard disk device are used. 

In conventional fingerprint matching systems, it has been hardly 
20 possible to prepare all the necessary data in a DRAM in econom- 
ical view, because of their enormous data amount. (According 
to a method described in "Automated Fingerprint Identification by 
Minutia-Network Feature - Matching Processes -" by Asai et al., the 
transactions of IEICE D-II, Vol. J72-D-II, No. 5, pp. 733-740, 1989, 
25 for example, data for one finger amount up to 1000 bytes.) Further, 
even if -the necessary data may bo deployed in a DRAM for high-speed 
processing, data transfer of large amount of data would have become 
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another bottleneck in most case. 

However, according to the. skin pattern matching system of the 
embodiment, or the present invention, the condensed feature vector v, 
and the confidence vector a do not amount but only to 10 bytes par 
5 finger even when five dimensions of one byte are considered for each 
vector. Therefore, a data storage of 100M bytes becomes sufficient 
for storing data of 10 million (10 7 ) fingerprints, enabling to deploy all 
the necessary data in a high-speed accessible semiconductor memory, 
a DRAM, in the data storing means 109. The hard disk is used here 
10 in parallel to backup the DRAM against incidents. A semiconductor 
disk, namely, a nonvolatile memory such as a flash memory, may be 
applied instead of the combination of the DRAM and the hard disk 
device. 

When registered data are referred, to, the database management 
15 means 108 sends each pair of the condenced feature vector v and the 
confidence vector cr to the matching section 13. 

Now thirdly, procedure in the matching section 13 is described. 
Controlled by the control section 14, the matching section 13 de- 
termines accordance/discordance of the data sent from the feature ex- 
20 traction section 11 to each data set delivered from the database section 
12, and outputs data management information such as the data ID of 
data sets regarded to have accordance with the data sent from the 
feature extraction means 11, as follows. 

The. similarity calculation means 110 calculates a similarity of a 
25 pair of the feature vector and the confidence vector sent from the fea- 
ture extraction means 11 to those delivered from the database section 
12. In the following paragraphs, the feature vector and the confidence 



vector from the feature extraction section are denoted as v s and <r s , 
respectively, while those from the database section are denoted as v f 
and cr J \ respectively. The similarity z(v s , v f , <r s , <r f ) is calculated 
according to following equation. 

Here, v' and v[ represent respective components of the feature 
vectors v* and v f and a\ and o{ represent respective component of the 
confidence vector er* and <r f . 

The similarity z(v s , v f , <r s , cr f ) is a scale of likeness and the 
10 smaller the similarity, the better the two feature vectors resemble. 

The similarity calculation means 110 may calculate the similarity 
as follows instead of above equation. 

, s f s f\ -<r ( 1 -M W"^ 1 (29) 

When calculating the similarity according to equation (29), com- 
15 putational time can be reduced by beforehand preparing inverse square 
root, l/rr'/ 2 , of each element of both the matching confidence vector a 
(from the feature extraction section) and the reference confidence vec- 
tor <r (from the database section 12). Equation (29) defines a distance 
when the? error distribution function accords to Laplace distribution 
(according to a distribution function f(x) = A: exp(— "|x|)). The dual- 
exponential distribution is sometimes applied for estimating errors in- 
cluding certain amount of singular noises, and the equation (29) gives 
better discrimination results than the equation (28) when low grade 
images are treated. 
25 Returning to the above equations, a it0 and Oi$ are both parame- 

ters whereof values are predetermined. For determining the parameter 
values, following example is an easy way to calculate th«n::. 
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That is, preparing A" (10 thousands, for example,) pairs of dif- 
ferent fingerprint images, each pair taken from each of A" different 
fingerprints, the feature vector v and the confidence vector <x of each 
image are calculated by the feature extraction section 11. Denoting 
respective vectors of a j-th. pair by v f,i , cr f,i and v s>i , cr s,i (j — 1, 2, . . ., 

A"), the parameters cr l>p and crip are calculated as follows. 
= \v( J - v°A 



\ 



1 K ( ■ ■ K I I \ 



10 



1 I< K ( K K . \ 2 

iV "~ 1 i=l Jt=l \ / = 1 m=l / 



= 

The determination means 111 selects and outputs information of 
the data which can be regarded to be coincide with the data supplied 
from the feature extraction means 11 among those registered in the 
15 database section 12. 

In the accumulation calculation performed according to the equa- 
tion (28) or (29) by the similarity calculation means 110, the calculation 
may be finished determining there is no coincidence when the distance 
accumulation attains to a certain threshold value. 
20 Thus, a fingerprint matching verification is performed in the skin 

pattern matching system of the embodiment. 

.Now, the skin pattern feature analyzer is described. 
FIG. 5 is a block diagram illustrating a first embodiment of the 
skin pattern feature analyzer according to the invention. 
25 The skin pattern feature analyzer is used for analyzing distribu- 

tion information among feature vectors extracted from a data set of 
skin pattern images, and outputs principal component vectors of the 
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feature vector distribution and error distribution information repre- 
senting error correlation between the quality indexes and the feature 
vectors. 

Referring to FIG. 5, the skin pattern feature analyzer 51 of the 
first embodiment comprises; 

a feature vector extraction means 501 for extracting a feature vec- 
tor from a skin pattern image, 

a principal component vector calculation means 502 for calculating 
principal component vectors of data distribution of the skin patter im- 
ages represented by the feature vectors extracted by the feature vector 
extraction means 510, 

a principal component vector storing means 503 for storing prin- 
cipal component vectors obtained by the principal component vector 
extraction means 502, 

a vector transfer means 504 for obtaining condenced feature vec- 
tors by performing the KLT of feature vectors extracted by the feature 
vector extraction means 501, 

a quality index extraction means 505 for extracting a quality index 
of the skin pattern images, and 

an error distribution information analyzing means 506 for analyz- 
ing correlation between error distribution of the quality index informa- 
tion delivered from the quality index extraction means 505 and that of 
the condensed feature vectors transferred by the vector transfer means 
505. 

FIG. 6 is a flowchart illustrating processes performed in the skin 
pattern feature analyzer 51 of FIG. 5, comprising a training feature 
vector extraction step 601, a variance-covariance matrix data accu- 
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rnulatiori step 602, a data finish determination step 603, an average 
vector/variance-covariance matrix calculation step 604, principal com- 
ponent vector calculation step 605, a quality index calculation step 
606, a pair vector extraction step 607. a pair vector KLT step 608, a 

5 pair vector error calculation step 609, an error distribution statistics 
calculation step 610, a pair vector finish determination step 611, and 
an error distribution output step 612. 

Now, operation of the embodiment is described, along with pro- 
cesses performed for preparing the principal component vectors to be 

10 used in the principal component vector storing means 104 and the error 
distribution information to be used in the error distribution informa- 
tion storing means 105 of FIG. 1, by way of example. 

_ A data set of skin pattern images should be beforehand prepared 
for obtaining the principal component vectors and- the error distribu- 

15 tion information to be used for the skin pattern matching system of the 
invention. Here also, a data set of fingerprint images are described to 
be prepared, by way of example, for obtaining above cUita concerning 
fingerprints to be used for the skin pattern matching system of FIG. 1. 
The data set is assumed to comprise data of N pairs (total 27V) 

2o of different images of N fingerprints. The better, the more number 
of pairs are applied for obtaining the error distribution information, 
but pairs more than 10 thousands give comparatively good results. 
The data set may be gathered by way of an image input device such 
an image scanner as mentioned in connection with the first embod- 

25 iment of the skin pattern matching system. However, a fingerprint 
database published by US National Institute of Standards and Tech- 
nology (hereafter abbreviated as NIST), the NIST Special Database 
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14, for example, is available. For cutting out image data of 512 x 512 
pixels from those of the NIST database, image center thereof should be 
detected, whereof a method is disclosed in a Japanese patent published 
as a specification No. 271884/89, for example. 

5 Returning to FIG. 6, extraction of the principal component vectors 

(steps 601 to 605) is described firstly. 

At steps 601 to 606, 2N feature vectors are extracted from the 
data set of 2N fingerprint images, a variance-covariance matrix of dis- 
tribution of the 2N feature vectors is calculated, and the principal 

10 component vectors are obtained from the variance-covariance matrix. 

As for obtaining the principal component vectors themselves, it is 
not necessary to prepare data set of paired fingerprint images. How- 
ever, it is economical to use the same data set for obtaining both the 
principal component 1 vectors and the error distribution information. 

15 Therefore, the principal- component vector calculation is described to 
be performed- with the 2iV fingerprint images, in the following para- 
graphs. 

The feature vector extraction means 501 extracts M (512 m the 
example) dimensional feature vectors ui (i = 1-, 2, . . ., 2N), each rep- 
20 resented by equation (22), from the data set of 2iVfingerprint images 
(at step 601), in the same way as the feature vector extraction -means 
102 of FIG. 1. 

The principal component vector extraction means 503 calculates 
statistic data of the extracted feature vectors u, for obtaining a 
25 variance-covariance matrix V thereof represented by equation (1). 

For calculating the variance-covariance matrix V directly accord- 
ing to equation (1), an average vector u should be calculated first 
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by accumulating each of 2N of U{, and then the variance-co variance 
matrix V should be calculated by referring to each U{ according to 
equation (1). Therefore, all 2A r of u t must be retained in a memory, 
or the feature vectors u t should be extracted twice for each operation. 
5 By this reason, the principal component vector calculation means 

502 of the embodiment calculates the variance-covariance matrix V 
according to following equation (34). 

1 2N 

V = ^j^XXui-TZXui-vY (33) 

I 2N 

10 = w^ih^-^ (34) 

1 2iV 

That is, an accumulation of the M chmensional feature vectors u { 
for obtaining the mean vector T£, and another accumulation of M x M 
matrix t^-uJ for obtaining first term r^-j* Viu\ of left side of the 

15 above equation (34) are sufficient to be calculated at step 602. These 
accumulations can be accomplished each time when an individual fea- 
ture vector U{ is extracted. Therefore, it is not necessary to retain all 
the feature vectors U{ at the same time or to extract them twice. 

After the steps 601 and 602 are repeated for the data set of ev- 

20 ( -ry of the fingerprint, images (determined at step 603), the principal 
component vector calculation means 502 calculates (at step 604) sec- 
ond terra of left side of the equation (34) from the mean vector u thus 
accumulated, for obtaining the variance-covaricince matrix V . 

Then, (at step 605) the principal component vector calculation 

25 means 502 calculates the principal component vectors by way of prin- 
cipal component analysis of distribution of the feature vectors ui with 
its variance-covariance matrix V obtained at step 604. The principal 
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component analysis is well known and briefly described in the previous 
paper of Q. L. Wilson et al. An explanation thereof can be also found 
in pp. 40-42 of the "Handbook of Image Analysis" previously referred 
to. 

M principal component vectors (i = 1, 2, . M\ called a first, 
a second, . . ., an M-th principal component vector, in order of sizes 
of corresponding eigenvalues) are obtained from a variance-covariance 
matrix V* of M x M dimensions. Upper several principal component 
vectors among them are sufficient to be used for the KLM. An ap- 
propriate employment number may be determined experimentally by 
performing the matching verification experimentally using feature vec- 
tors actually processed through the KLM. In the case of the fingerprint 
image, upper two principal component vectors have conspicuously good 
characteristic. Hence, upper 5 to 6 principal component vectors cor- 
responding to largest eigenvalues are sufficient to-be applied. Here, L 
principal component vectors are assumed to be selected. 

Returning to FIGs. 5 and 6, the principal component vector calcu- 
lation means 502 stores the L principal component vectors &i (/ = 1, 
2, . . ., L) in the principal component vector storing means 503. 

Thus, extraction of the L principal component vectors & t is per- 
formed. 

Then, the error distribution analysis is described referring to steps 
606 to 612 of FIG. 6. 

In the error distribution analysis, correlation between the error 
distribution and the quality index of paired condensed feature vectors, 
obtained from a data set of paired images and processed through the 
KLT, is calculated. As beforehand premised, the error distribution 
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analysis will be described to use the same data set of N pairs of fin- 
gerprint images used to obtain the principal component vectors 
However, it may be performed with another data set of sufficient num- 
ber of paired and different fingerprint images, each pair thereof taken 
from a same finger. 

At steps 606 to 611, error distribution information is obtained from 
the quality indexes and the condensed feature vectors of the paired 
fingerprint image data. 

The quality index extraction means 505 calculates (at step 606) a 
quality vector Q itj (i = 1, 2, . . TV; j = 1, 2) of each (j = 1, 2) of z-th 
pair of images in the same way as described in connection with the skin 
patterii"matchiiig system of FIG. 1, according to following equations. 



QiJ.5 



Qij, 



V Qij,L J 



(36) 



Qij. i = ^UjAcyMC)* (37) 

Here, Qijjlc) and ^i(C') (I = 1, 2, . . L) are C'-th components of 
the ridge direction confidence vector and that of the principal compo- 
nent vector to be used for the KLT, respectively, as described in con- 
nection with equation (25). The quality vectors Q i} thus calculated 
are supplied to the error distribution information analyzing means 506. 

On the other hand, the feature vector extraction means 501 ex- 
tracts (at step 607) feature vectors u itj (i = 1, 2, . . ., N; j = 1, 2) from 
image data of i-th fingerprint. 

The vector transfer means 504 performs the KLT of the paired 



feature vector u {J (at step 60S), that is, performs the KLT according 
to following equation (38) making use of L principal component vectors 
3/, to obtain paired condensed feature vectors v {J . 

v ij;2 



20 



Vi.j = 



(39) 



10 The paired condensed feature vectors v itj thus obtained are also 

supplied to the error distribution information analyzing means 506. 
The error distribution information analyzing means 506 analyzes 
- correlation between the quality index and the error distribution refer- 
ring to quality vectors Q {J delivered from the quality index extraction 
15 , means 505 and the condensed feature vectors ViJ delivered from the 
vector transfer means 504, and prepares a lookup table, or an error 
distribution table, representing relation between standard deviation 
of error values to quality index such as illustrated in FIG. 4 concerning 
each dimension of these vectors having the same L dimensions. More 
concretely, each time when a pair of condensed feature vectors «y and 
corresponding pair of quality vectors Q tJ are delivered, the error dis- 
tribution information analyzing means 506 registers error value of of 
each component of the condensed feature vectors into a corresponding 
table entry prepared for each dimension according to ranks k of the 
25 quantized quality index value (at step 609), for calculating standard 
deviation a,., of the error values for each rank k of each dimension / 
according to following equations, said error value being deviation of 
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each of components of the condensed feature vectors Vij from their 
mean value. 



\ 



1 - ' (40) 



where N L .j = Z^.iet 1, = ZjV iJtl , and 

* w = J 4(* t ! - 1) " Vix,Y wheu ' = 2 - (41) 

Here, Nkj'is & number of data classified into each table entry, and 
first summation HQ iJt ^k means a summation of concerning data corre- 
sponding to quality index value Qijj to be quantized into A>th rank. 
The error value as above defined in equation (40) becomes difference 
between corresponding components of each pair of the condensed fea- 
ture vectors 'obtained from the same fingerprint, when the data set 
is composed of paired (only two) image data. When more than two 
images from one fingerprint can be obtained, more precise mean value 
estimation, and hence, error value estimation can be obtained. There- 
fore, the rnon; images are the more preferable. 

In the embodiment of FIG. 5, the error distribution information 
analyzing means 506 operates as follows. 

In advance, threshold values for quantizing each component of the 
quality vectors Q t j arc determined according to distrihu tiou of the 
quality vectors Qij. When value range of a dimension of the quality 
vector Q-j is from Q in in to Q, naXi each of the threshold values ori, or-2, 
. . ., a- n _i is determined so as to quantize the value range into n ranks, 
256, for example. Corresponding to each rank of each dimension, an 
error distribution table having n x L entries is prepared. 

The error distribution information analyzing means 506 compares 
(at step 610) each component Qi t ij of a quality vector Q i{ to the 
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threshold values for obtaining corresponding rank k it i } and accumu- 
lates a square error value (wf,i,/-u,-,2,/) 2 of equation (41) calculating from 
corresponding components of corresponding pair of condensed feature 
vectors vi t \ and v;,2 onto a table entry indicated by the rank k\ i. The 
5 same square error value (w t ,i,/ — v«,2,/) 2 is a lso accumulated onto another 
(or the same) table entry indicated by another rank k- 2i i obtained from 
partner quality vector Q i 2 - Thus, square error values of all dimensions 
of the pair of feature vectors v it i and Vi,j are registered in the error 
distribution table. 

10 After finishing registration of the square error values of all pairs 

of feature vectors hi the data set (determined at step 611), the error 
distribution information analyzing means 506 outputs the standard de- 
viation of the error values of each table entry calculated according 
to equation (41) as the error distribution information (at step 612)r 

15 When there is no data or only oue square error value in a table entry, 
the equation (41) cannot be applied. In the case, a certain default value 
may be output, or a value interpolated from neiboring table entry may 
preferably output, when the quality index is quantized sufficiently fine, 
into 256, for example. 

20 Thus, the principal component vectors and the error distribution 

information previously described to be referred to by the first embod- 
iment of FIG. 1 of the skin pattern matching system are analyzed. 

FIG. 7 is a graphic chart illustrating an analysis result, that is, 
an experimental output representing standard deviation of errors of a 

25 dimension according to quality index value. 

In the foregoing paragraphs, first embodiments of the skin pattern 
matching system and the skin pattern feature analyzer aio described, 



wherein eigenvalues obtained along with ridge direction extraction are 
used as . the quality index. 

In the following paragraphs, second embodiments of the skin pat- 
tern matching system and the skin pattern feature analyzer are de- 
scribed, wherein the quality index is calculated according to a distance 
of a concerning feature vector from a proper distribution of feature 
vectors. 

First, principle of quality index measurement of the second em- 
bodiments is described. 

In the second embodiments, a reference measure is relied upon a 
distance from a concerning feature vector to a closed space wherein 
feature vectors without noises are gathered. Representing" the closed 
space by a set of sample points, a distance to a nearest sample point 
is defined as the quality index. 

In the following paragraphs, principle.of quality index extraction 
is described first- 
Feature vectors obtained without noises from high-grade pattern 
images are localized in a certain closed part of a space having the 
same dimensions with those of the feature vectors. An example of 
the dosed part is denoted by Q in FIG. 8 illustrating a space of the 
dimensions. Data samples of feature vectors having high-grade quality 
index without noises are represented by black dots in the closed space 

When there are sufficient number n s of the data samples in the 
closed space Q, distances between neighboring feature vectors converge 
to zero. That is, following equation stands with any feature vector xin 
the closed space Cl. 



lim min||x- 2/||=0 (42) 
Consider a feature vector X, originally to be in the closed space 
Q w l iell there is no noise, is extracted as another feature vector O of 
FIG. 8 from outside of the closed space Q because of mingled noise 
vector iV. 

The quality index defined in the second embodiments is a distance 
from a sample point Y nearest to the concerning feature vector 0, 
which is expressed as \\Y - 0\\. This distance should be the same with 
the distance to the closed space Q when there are sufficient number of 
sample points. 

Hence, the distance to the closed space Q can be approximated by 
obtaining a minimum value of distances to feature vectors in a database 
where sufficient number of feature vectors without noise are prepared. 

Now, a concrete example of the second embodiments is described. 
In the second embodiments, following elements of FIG. 1 are modi- 
fied, that is, the quality index extraction means 106 or 505, the confi- 
dence attribution means 107, the error distribution information storing- 
means 105, and the error distribution information analyzing means 506, 
and other elements are left unchanged. Furthermore, in the first em- 
bodiments of FIG. 1 and FIC 7 . 5, the quality index extraction means 
106 or. 505 is depicted to extract quality indexes directly from, image 
data. However, in the second embodiments, the quality index extrac- 
tion means 106 or 505 is supplied with feature vectors after condensed 
through the KLT by the vector transfer means 103 or 505. 

FIG. 9 is a block diagram illustrating a quality index extraction 
means 90 according to the second embodiments, comprising a data- 
base 903 wherein a plurality of feature vectors without noise and pro- 
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cessed through the KLT are prepared, a distance calculation means 
901 for calculating a distance between an input feature vector and the 
plurality of feature vectors prepared in the database 903, a distance 
revision means 902 for revising/retaining a minimum value among the 

5 distances calculated by the distance calculation means 901, and a con- 
trol means 904 for controlling* above elements of the quality index ex- 
traction means 90. 

Now, operation of the quality index extraction means 90 of the 
second embodiments is described. 

10 FIG. 10 is a flowchart illustrating processes performed in the qual- 

ity index extraction means 90 of FIG. 9, comprising a feature vector 
distance calculation step 1001, a minimum distance revision step 1002 
and a finish determination step 1003. 

First, a distance, namely a similarity of an input feature vector to 

15 that in the database 903 is calculated (at step 1001)- 

In the database 903, the plurality of high-quality ; feature vectors 
are prepared processed through the KLT. Although the high-quality 
may be discriminated by way of expert's eye, it can be preferably 
discriminated automatically referring to standard deviation of errors 

20 among at least two feature vectors (after the KLT) taken from the Same 
fingerprint. Sets of feature vectors obtained from the same pattern 
images giving the standard deviation of errors smaller than a threshold 
value are selected to be of the high-quality with few noises. As for the 
number of feature vectors, more than 10 thousands may be sufficient 

25 in the case of fingerprint. 

The distance of the input feature vector is calculated according to 
the Euclidean distance represented by equation (4), for example. 
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The distance revision moans 902 revises a retaining minimum value 
when thedistance newly calculated is smaller than the retaining min- 
imum value (at step 1002). 

Tho control means controls the quality index extraction means 90 
to repeat steps 1001 and 1002 until distance calculation of an input 
feature vector to all the feature vectors registered in the database 903 
is finished (determined at step 1003). Thus, the distance of the input 
feature vector to the. set of reference data can be calculated to be output 
as the quality index Q. In the second embodiments, the quality index 
lft Q has a scalar value, different from the quality index having vector 
value of the first embodiments. 

The second embodiment of the skin pattern feature analyzer pre- 
pares the error distribution table making use of the quality indexes Q _ 
thus extracted by the quality index extraction means 90 from a data 
15 set having appropriate quality range. An error distribution information 
analyzing means similar to the error distribution information analyzing 
means 506 of FIG. 5 may calculate the standard deviation of the error 
values according to equation (40) or (41) regarding each component 
has the same value Q i , j for each paired feature vectors v iA and 

Here, the error distribution table is not necessary to be a 2- 
dimensional as illustrated in FIG. 4. The error distribution table of 
the second embodiments is sufficient to be 1-dimensional as illustrated 
in FIG. 11. An experimental result of the error distribution table of 
25 FIG. 11 is shown as a graphic chart of FIG. 12 corresponding to that 
of FIG. 7 

The- skin pattern matching system of the second embodiment per- 



- 43 - 

forms skin pattern matching verification making use of the quality 
index Q obtained by the quality index extraction means 90. The skin 
pattern matching verification preformed here is described also referring 
to FIG. 1. 

5 Processings performed in the quality index extraction means 106 

of FIG. 1 is executed by the quality index extraction means 90 in 
the second embodiment, whereto condensed feature vectors processed 
through the KLT are input from the vector transfer means 103, instead 
of source feature vectors input directly from the feature extraction 

10 means 103 in the first embodiment. 

In the error distribution information storing means 106, the error 
distribution information is registered in a 1-dimensional error distribu- 
tion table. 

The confidence attribution means 107 outputs the standard devi- 
15 ation of errors referring to the 1-dimensional error distribution table in 
the quality index storing means 106 by accessing thereto with the scalar 
quality index Q obtained from the quality index extraction means 90 
corresponding to concerning feature vector v. 

Other processings are performed in the same way with the first 
20 embodiment, and duplicated descriptions are omitted. 

In the following paragraphs, third embodiments of the skin pattern 
matching system and' the skin pattern feature analyzer is described, 
wherein a distance of a ridge line pattern to a reference pattern is 
adopted as the quality index. 
25 FIG. 13 is a block diagram illustrating a configuration of the qual- 

ity index extraction means 130 according to the third embodiments, 
comprising; 
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a first, a second and a third direction pattern storing means 1301, 
1304 and' 1306, 

a distance calculation means 1302 for calculating distances be- 
tween input ridge direction patterns stored in the first direction pat- 
tern storing means 1301 and affine transferred ridge direction patterns 
stored in the third direction pattern storing means 1306 referring to 
their confidences stored therewith, respectively, 

a parameter revision means 1303 for determining whether the dis- 
tance calculated by the distance calculation means 1302 is the shortest 
or not, and memorizing affine parameters when the distance is the 
shortest, 

an affine transfer means 1305 for performing affine transfer of.ridge 
direction patterns and their confidences stored in the first and the 
second direction pattern storing means 1301 and 1304, the obtained 
affine transformations being stored in the third direction pattern, stor- 
ing means 1306, and 

a control means 1307 for controlling operation of each element of 
the quality index extraction means 130 including parameter control of 
the affine transfer. 

FIG. 14 is a flowchart illustrating processes performed in the qual- 
ity index extraction means 130 of FIG. 13, comprising an affine transfer 
step 1401, a distance calculation step 1402, a distance/affine parameter 
revision step 1403, and a finish determination step 1404. 

Now, referring to FIG. 14, operation of the quality index extrac- 
tion means 130 of FIG. 13 according to the third embodiment is de- 
scribed. 

Ridge direction patterns B(C) and their confidences q{C) such as 
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previously described in connection with the first embodiment of the 
skin pattern matching- system are input to the first direction pattern 
storing means 1301. In the second direction pattern storing means 
1304, reference ridge direction patterns 6(C) and their confidences 
5 Q(C) *"-•<: stonjd. The reference ridge direction patterns 0(C) and 
their confidences Q(C) are prepared, for example, by obtaining mean 
values of n (10 thousands, for example) sets of ridge direction patterns 
9{ (;' = 1, 2, n) according to following equations. 

6 X (C) = -Ecos^C)) (43) 

10 e v (C) = ^X>in(20 t -(C)) (44) 

- b^ l Wi (45) 

Q(C) = y/Q*(C)* + e y (C) 2 - (46) 
The affine transfer means 1305 performs affine transfer (at step 

15 1401) of direction patterns and their confidences of an input pattern 
image stored in the first direction pattern storing means 1301 using 
affine parameter sets each determined according to each ensemble of 
parallel/rotation displacement values (Ai, At/, A0) in a search range. 
The affine transfer is w«ll known and described also in pp. 423- 

20 429 of the previous "Handbook of Image Analysis". Hence, detailed 
explanation is omitted. However, it is to be noted here, in the affine 
transfer of the ridge direction pattern, that component values of the 
ridge direction patterns 0(C) are defined relatively to the coordinate 
system and they are variable when the coordinate system is such ro- 

25 tatcd as in the affine transfer, deferently from ordinary affine transfer 
of images. Hence, for the rotation A0 of the coordinate system, A0 is 
added to each component value of the ridge direction patterns 0(C). 



The obtained affine transformations are registered ..in the third 
direction pattern storing means 1306. The size of the affine transfor- 
mations to be stored in the third direction pattern storing means 1306 
are adjusted to be the same with the source ridge direction patterns 
in the first direction, pattern storing means 1301. Where there is no 
reference point, concerning confidence is set to be null. By prepar- 
ing the reference ridge direction patterns 0(C) and their confidences 
Q(C) to be stored in the second direction pattern storing means 1304 
to have larger sizes than ridge direction patterns of the input pattern 
image, parts having no reference point can be reduced and the transfer 

precision is improved. 

As for the search range of the parallel/rotation displacement val- 
ues (Aa\ At/, A0), it can be defined as follows, for example. When 
the ridge direction pattern 0(C) has a size of 16 x 16, as in this case, 
nine values -4, -3, . . ., +3, +4 are assigned for both the parallel dis- 
placements Aa: and A?/, and seven values -30°, —20°, . . ., +20° , +30° 
for the rotation displacement A0. Thus, 9 x 9 x 7 = 567 displacement 
ensembles are obtained. Further, by applying the image center detec- 
tion method disclosed in the Provisional Publication No. 271884/'S9 
beforehand mentioned, the search range can be reduced around the 
center of fingerprints for economizing computational time. 

The distance calculation means 1302 calculate the distanced (at 
step 1402) according to following equation for each affine parameter 

set " , r.ci(crnQ{C)r{\o x {C) - /•(e.co)!* + mo - ^(Q,(g))i a ) (47) 

where, 

B X {C) = cos(2i9(C)) W 



0 tf (C) = sin(2<9(C)) (49) 

Here;,' F(*) represents the affine transformation of *; and 7 is a 
parameter having a value 0.5* for example. 

The parameter revision means 1303 checks whether the distance 
D is the; shortest for a concerning input pattern image, and registers 
the distance and values of the affine parameter set giving the distance, 
when it is found to be the shortest (at step 1403). 

The. quality index extraction means 103 repeats steps 1401 to 
1403 for each affine parameter set in the parallel/rotation displacement 
range calculating the distance D according to equation (47). When 
above repetition is finished (at step 1404) for a input pattern image, 
the revised minimum value of the distance D is output as the quality 
index. 

The third embodiments of the skin pattern matching system and 
the skin pattern analyzer are embodied by comprising the above de-. 
scribed quality index extraction means 130. The quality index output 
from the quality index extraction means 130 has a scalar value and 
may be treated in the same way with that obtained from the quality 
index extraction means 90 of FIG. 9 of the second embodiments of the 
invention, duplicated explanation being omitted. 

Further, by performing affine transfer of each input pattern im- 
age making use of the affine parameter set giving the shortest distance 
thereof, the input pattern image can be aligned in the coordinate sys- 
tem. Therefore, the affine transfer may be applied also in the first 
embodiments of the skin pattern matching system and the skin pat- 
tern analyzer for coordinate .alignment of input data, that is, input 
image data or ridge direction data extracted as the feature vector. 



Still further, the afniie transfer is described to be performed each 
time with. each affine parameter set in the search range of the paral- 
lel/rotation displacements. However, a database may be beforehand 
prepared, wherein affine transformation data of all components of the 
ridge direction patterns for all displacements in the search range are 
registered. Then, the quality index is extracted by calculating the dis- 
tance to all the data registered in the database in the similar way with 
the quality index extraction means 90 of FIG. 9 of the second embodi- 
ments. By pre-performing such time consuming processes as the affine 
transfer, calculation time can be still reduced. 

In the fourth embodiment of the skin pattern matching system, 
the fingerprint matching verification is performed making use of all 
or some of_the three quality index extraction means 505, 90 and 130 
herrtofore described, and commonly available parts are jointly used. 

FIG. 15 is a block diagram illustrating the fourth embodiment 
of the skin pattern matching system of the invention, wherein all the 
three quality index extraction means are applied. 

Referring to FIG. 15, the skin pattern matching system of the 
fourth embodiment has a feature extraction section 151 for extracting 
feature data from skin pattern images, a database section 12 for storing 
and managing the feature data, a matching section 13 and a control 
section 14. 

The database section 12, the matching section 13 and the control 
section 14 may have the same configuration with those of FIG. 1, and 
so, duplicated description is omitted. 

The feature extraction section 151, which takes charge of out- 
putting a feature vector and standard deviation of estimated errors ot 



an input, skin pattern image data, comprises; 

an image input means 1501 where image data of a skin pattern 
such as a fingerprint or a palm print are input, 

a ridge direction extraction means 1502 for extracting a ridge di- 
rection pattern and its confidence from the image data input through 
the image input means 1501, 

a center detection means 1507 for detecting center of the image 
data input through the image input means 1501, 

a coordinate alignment means 1508 for performing coordinate 
alignment of the ridge direction pattern and its confidence extracted 
by the ridge direction extraction means 1502, and for calculating a 
first quality index according to conformity obtained along with the 
coordinate alignment, 

- a principal component vector storing means 1503 wherein are pre- 
pared principle component vectors of distribution of vectors consist- 
ing of direction patterns processed by the coordinate alignment means 
1508, 

a vector transfer means 1504 for generating a feature vector by 
performing the KLT of the vector of the direction pattern processed 
by the coordinate alignment means 1508 making use of the principal 
component vectors prepcired in the principal component vector storing 
means 1503, 

a distance calculation means 1505 for obtaining a second quality 
index by calculating a minimum distance of the feature vector pro- 
cessed by the vector transfer means 1504 to a high-quality data set of 
feature vectors beforehand prepared, 

a contribution calculation means 1506 for obtaining a third quality 
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index of each dimension of the feature vector from its confidence aligned 
by the coordinate alignment means 1508 and the principal component 
vectors, 

a first error distribution information storing means 1513 wherein 
standard deviation of errors of the feature vectors corresponding to the 
first quality index is prepared in a first lookup table, 

a second* error distribution information storing means 1514 
wherein standard deviation of errors of the feature vectors correspond- 
ing to the second quality index is prepared in a second lookup table, 

a third error distribution information storing means 1515 wherein 
standard deviation of errors of the feature vectors corresponding to the 
third quality index is prepared in a third lookup table, 

a first confidence attribution means 1509 for obtaining a first con- 
fidence value to be attributed to the feature vector by referring to the 
first lookup table accessed with the first quality index, 

a second confidence attribution means 1510 for obtaining a second 
confidence value to be attributed to the feature vector by referring to 
the second lookup table accessed with the second quality index, 

a third confidence attribution means 1511 for obtaining a third 
confidence value to be attributed to the feature vector by referring to 
the third lookup table accessed with the third quality index, and 

a confidence estimation means 1512 for outputting a confidence 
estimation of the feature vector according to the first, the second and 
the third confidence value. 

Now, operation of the fourth embodiment of the skin pattern 
matching system will be described referring to FIG. 15. 

Each of the above means except for the confidence estimation 



means 1512 can be realized by applying each corresponding means 
heretofore, described in connection with the first to the third embodi- 
ments. Hence, these' means other than the confidence estimation means 
1512 are briefly described, here. 

The ridge direction extraction means 1502 extracts the ridge di- 
rection pattern and its confidence in the same way with the feature 
vector extraction means 101 and the quality index extraction means 
106 of FIG. 1, such as disclosed in the Provisional Publication No. 
7()79/'9G. 

The coordinate alignment means 1508 outputs the first confidence 
indication obtained by calculating a distance of the ridge direction pat- 
tern to a reference pattern in the same way with the quality index ex- 
traction means 130 of FIG. 13, where the distance is a minimum value 
of D of equation (47) obtained when the ridge direction pattern is most 
fitted to the reference pattern by positioning the ridge direction pattern 
to the reference pattern. Here, search range of the parallel/rotation 
displacement is set around the center of the fingerprint detected by 
the center detection means 1507 such as disclosed in the Provisional 
Publication No. 27i884/'89 beforehand mentioned. Further, position 
of the ridge direction pattern and its confidence are normalized here 
by performing the affine transfer using the affine parameter set giving 
the highest conformity. The coordinate alignment means 1508 outputs 
the ridge direction pattern as a vector value expressed by equation (22) 
referred to in connection with the first embodiments. 

The vector transfer means 1504 performs the KIT of the vector 
output of the coordinate alignment means 1508 for outputting a feature 
vector according to equation (23) referring to the principal component 
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vectors prepared in the principal component vector storing means 1503, 
in the same way with the vector transfer means 103 of FIG. 1. 

The distance calculation means 1505 outputs the second quality 
index obtained by calculating minimum distance of the feature vector 
to the high-quality data set in the same way with' the quality index 
extraction means 90 of FIG. 9 beforehand described in connection with 
the second embodiments. 

The contribution calculation means 1506 outputs the third quality 
index by calculating confidence value of the ridge direction pattern for 
each component of the feature vector according to equation (25), in 
the same way with the quality index extraction means 106 of FIG. 1 
described in connection with the first embodiments. • 

The first, the second and the third confidence attribution means 
1509, 1510 and 1511 output the first, the second and the third con- 
fidence value, respectively, for each component of the feature vector, 
obtained by referring to respective lookup table accessing with respec- 
tive quality index thus obtained of the feature vector. 

Contents of each of the first, second and the third lookup tables in 
the first, the second and the third error distribution information stor- 
ing means 1513, 1514 and 1515 can be prepared in the same way as 
described in connection with the third, the second or the first embodi- 
ments, respectively, by analyzing respective error distribution obtained 
through the coordinate alignment means 1508, the distance calculation 
means 1505 or the contribution calculation means 1506, respectively, 
from a data set of fingerprint images having an appropriate quality 
range. 

The first, the second and the third confidence value being denoted 
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by three vectors } cr, 2 a and 3 cr, respectively, the confidence estima- 
tion means 1512 estimates the confidence estimation <rfrom the three 
vectors according to following equation. 



a t = 



\ 



£ 'V? (50) 



Here, ^represents an z-th component of the confidence estimation 

<r, and *a\ represents the z-the component of the first to the third 

confidence value -J'cr,-. 

Or, otherwise-:, the confidence estimation <rmay be estimated as 

follows instead of above equation. 

10 cr t - = max'^ (51) 

i 

The confidence estimation means 1512 outputs the feature vector 
processed through the KLT and its confidence estimation cr as output 
of the" feature extraction section 151. 

By applying the confidence estimation thus integrated from more 
15 than one" quality index value, a better result can be obtained, demerits 
of each individual quality index being compensated, according to the 
fourth embodiment. 

In the following paragraphs, a fifth embodiment of the skin pattern 
matching system of the invention will be described, wherein Fourier 
20 transformation of the skin pattern image is applied to the feature vector 
extraction thereof. 

First, principle of the fifth embodiment is explained referring to a 
schematic diagram of FIG. 16. 

In representatives of the fingerprint pattern, there are the Arch, 
25 the Loop, the Whorl and so on. These patterns have their own forms, 
and hence, 2-dimensional power spectrums of Fourier transformation 
thereof have their own features, as illustrated in FIG. 16. 



Referring to FIG. 16, al, bl and cl represent the Arch, the Loop 
and the Whorl, respectively, a2, b'2 and c2 representing characteristic 
parts of the Fourier power spectrums thereof (direct current, or zero 
frequency component, being set to their centers). 

In each of the Fourier power spectrums a2, b2 and c2, lower fre- 
quency components, that is, inner patterns, owe to uneven stamping, 
stamping pressure or background of the fingerprint image and they are 
not significant for discriminating the fingerprint. The spectrum lines of 
horizontal and vertical zero frequency, that is, xy-coordinate axis-like 
lines, represent noises owing to discontinuity at end lines of the image, 
and have no reference with the fingerprint discrimination. 

On the other hand, the higher frequency~components, that is, the 
outer patterns such as 3-like pattern of the spectrum a2 or a ring 
pattern of the spectrum c2, represent features concerning fingerprint 
ridge lines, and substantially. show following three characteristics. 

1. Radial distance p of spectrum distribution center from the 
direct current component represents mean value of the ridge line pitch; 

2. Rotation direction cj> of the spectrum distribution center repre- 
sents whether the fingerprint hits right inclination or left inclination. 

3. Whether the spectrum distribution is peak-like or ring-like 
corresponds to arch-like or whorl-like of the fingerprint. 

Therefore, by sampling most characteristic frequency band from 
the Fourier power spectrum of the fingerprint pattern by filtering out 
unnecessary high frequency components and low frequency compo- 
nents, a feature value representing a whole fingerprint pattern can be 
extracted. 

Column charts a3, b3 and c3 of FIG. 16 schematically illustrate 
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feature values of respective! fingerprint patterns al, bl and cl sampled 
with a fixed frequency band, namely, with a fixed radial distance p 
around the direct current (0 < q> < t). 

Now, the fifth embodiment, of the skin pattern matching system 
5 of the invention based on the above principle is described. 

FIG. 17 is a block diagram illustrating a feature vector extraction 
means of the fifth embodiment corresponding the feature vector extrac- 
tion means 102 of FIG. 1, comprising a Fourier transfer means 1701 for 
performing Fourier transfer of a fingerprint image, a power calculation 
10 means 1702 for calculating Fourier power spectrum of the Fourier trans- 
formation output of the Fourier transfer means 1701, a filtering means 

1703 for filtering the Fourier power spectrum, and a sampling means 

1704 for sampling characteristic spectrum components from output of 
the filtering means 1703 to be output as the feature vector. 

15 The skin pattern matching system of the fifth embodiment com- 

prising the above feature vector extraction means operates as follows. 

The. Fourier transfer means 1701 performs digital Fourier transfer 
of the input 2-dimensional pattern image. As to the digital Fourier 
transfer, it is well known and also described in pp. 5-11 of the "Hand- 
20 book of Image Analysis" , explanation thereof being omitted. Here, the 
fingerprint image is expressed by /i(z,y), Fourier transfer thereof by 
F{h(x,y)) and Fourier components transferred by the Fourier transfer 
means 1701 by H{u,v), where {x,y) represents coordinates in the real 
space and ( a, v) represents corresponding coordinates in the frequency 
25 domain. Hence, manipulation performed by the Fourier transfer means 
1701 is expressed by following equation. 

H(u,v) = F(h(x,y)) ( 52 > 
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The power calculation means 1702 calculate absolute value 
\\H{u, a) 1 1- of the Fourier components H{u,v), obtained as a complex 
number, as follows. 

(«, v)\\ = y/WH(u,v))* + S(H{u t v))* t (53) 
5 where ft{H{u,v)) and %{H(u,v)) represent real part and imaginary 
part of the Fourier components #('",u), respectively. 

The filtering means 1703 performs, for example, convolution op- 
eration (Gaussian filtering) making use of well known 2-dimensional 
- Gaussian function G(u, v\ <j), for filtering the Fourier power spectrum 
10 ||#Kv)|| output of the Fourier transfer means 1702, as follows when 
filtered image data is expressed by J(u,v). 

J(u,v) = Y2J2G(p,q;a)\\H(u + p t v + q)\\ (54) 



(55) 



1 ( u 2 + v 2 

G(u,v-a) = _exp -— p- 



Here, the parameter a of the 2-dimensional Gaussian function may 
15 be set to be about '3 to 7 pixels (counted in the frequency domain), 
when the input image has 512 x 512 pixels. 

The sampling means 1704 samples pixel data of the filtered Fourier 
power spectrum J(u, v) in a frequency band defined by following equa- 
tions at an appropriate interval d, as illustrated in a schematic diagram 
20 of FIG. 18. 

n < li 2 + v 2 < r 2 ( 56 ) 

„>o ( 57) 

In an example of the embodiment, a feature vector /is obtained, 
from near 200 samples by setting n = 20, r 2 = SO and the sampling 

25 r» 

interval d as 10 x 10. 

Size of the feature vector ||/||refiects signal intensity of the object 



- 57 - 

fingerprint, image, and so, can be used as the quality index of the 
feature vector f. 

Thus, the feature vector and its quality index are obtained in 
the fifth embodiment of the skin pattern matching system. Other 
component than the feature vector extraction means may be configured 
in the same way with the first to the fourth embodiments heretofore 
described, by "applying the above feature vector extraction means to 
the feature vector extraction means 102 of FIG. 1, for example. 

In the embodiments heretofore described, the feature vector pro- 
cessed through the KLT is applied for the skin pattern matching ver- 
ification or the skin pattern analysis. However, the scope of this in- 
vention of the image feature analyzer and the image matching system 
is not limited in the feature vector processed through the KLT. As an 
example without the KLT, an embodiment making use of feature val- 
ues defined by singular points such as the cores and the deltas in the 
fingerprint will bo described in the following paragraphs. 

Maximum number of the cores and the deltas in the fingerprint 
is usually found in the Whorl, wherein are found four singular points, 
two cores and two deltas. There can be defined 4 C 2 = 6 segments 
connecting these four singular points. Therefore, 12 feature values can 
be obtained, that is, 6 lengths of the 6 segments and 6 numbers of ridge 
lines crossing the 6 segments. Further, each of the 12 feature value has 
each confidence value, as described in Uchicla et al., previously referred 
to. These confidence values can be used for the quality index (and 
called the quality index, hereafter). 

Therefore, following vectors can be defined from these feature val- 
ues and their quality indexes. 
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quality index: q = 



(59) 



\ Qi2 I 

Here, when there are found but less than four singular points as 
in the Loop, or when some singular points are_failed to be detected, 
corresponding components of the quality vector v are substituted with 
a value out of bounds ( — 1, for example, when the confidence value is 
0 to 1). 

FIG. 19 is a block diagram illustrating a basic configuration of the 
sixth embodiment of the skin pattern matching system, wherein the 
vector transfer means 103 and the principal component vector storing 
means 104 are omitted compared to the skin pattern matching system 
of FIG. 1. 

Referring to FIG. 19, the sixth embodiment of the skin pattern 
matching system has, 

a feature extraction section 191 comprising an image input means 
1901, a feature vector extraction means 1902, a error distribution infor- 
mation storing means 1904 and a confidence attribution means 1905, 



a database section 12 comprising a data storing means 109 wherein 
prepared - the feature data extracted by the feature extraction section 
191, and a database management means 108 taking charge of reference 
or registration of the feature data in the data storing means 109, 

a matching section 13 for performing the skin pattern matching 
verification to output matching results comprising a similarity calcula- 
tion means 110 for calculating a similarity of the feature data supplied 
from the feature extraction means 191 to each of the feature data stored 
in the database section 12, and a determination means 111 for deter- 
mining accordance/discordance from the similarity calculated by the 
similarity calculation means 110, and 

a control section 14 for controlling each of the above elements. 
The database management section 12, the matching section 13 
and the control section 14 operates in the same way with those of FIG. 
1, and so, operation of the feature extraction section 191 is described, 
here. 

The feature vector extraction means 1902 extracts the feature vec- 
tor ^according to equation (58) as above described referring to the 
singular points of the cores and deltas. 

The quality index extraction means 1904 extracts the quality vec- 
tor q according to equation (59). 

• In the error distribution information analyzing means 1903, there 
is prepared a lookup table wherein registered standard deviation of 
errors of components Vi of each dimension of the feature vector 

5 v. When the quality index value is that of out of bound, -1, because of 
missing data, a fixed value is registered there. As for the fixed value, 
it is sufficient to be- more than 1000 times of the ordinary standard 
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deviation, or zero when inverse standard deviation is registered in the 
lookup table. 

The confidence attribution means 1905 outputs a confidence vector 
<rby referring to the lookup table in the error distribution information 
5 analyzing means 1903 by accessing thereto with the quality vector q. 

Then, the same procedure follows as beforehand described in con- 
nection with the first embodiment of the skin pattern matching system. 

The lookup table in the error distribution information analyzing 
means 1903 is prepared by a fourth embodiment of the skin pattern 
10 feature analyzer, whereof a block diagram is illustrated in FIG. 20. 

Referring to FIG. 20, the sldn pattern analyzer of the fourth em- 
bodiment comprises a feature vector extraction means 2001, a quality 
index extraction means 2002 and an error distribution information an- 
alyzing means 2003. 
15 The feature vector extraction means 2001 extracts feature vectors 

vfrom a data- set of a plurality, 10 thousands, for example, of paired 
images according to equation (58). The quality index extraction means 
2002 extracts quality vectors q from the data set according to equation 
(59). 

20 The error distribution information, analyzing means 2003 prepares 

a 2-dimensional lookup table by calculating error distribution for each 
quantized quality index value of each dimension, analyzing the error 
distribution in the same way with the error distribution information 
analyzing means 506 of FIG. 5. Here, data corresponding to the quality 

25 index value out of bounds, -1, are omitted from the accumulation 
operation regarded as defect data. 

Thus, the skin pattern feature analyzer and the skin pattern 
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matching system of high-precision can be embodied even without the 
KLT. ' . 

In the embodiments heretofore described of the invention, match^ 
ing of one fingerprint is discussed. However, it can be easily understood 
that the present invention can be applied to the Ten Print Card. 

When applying to the Ten Print Card, the operation for one fin- 
ger as heretofore described may be repeated ten times for each of ten 
fingers, preparing data of feature vectors and confidence vectors for ten 
fingers in the database section and so on. 

Further, the condensed feature vectors (5-dimensional, for exam- 
ple,) processed through the KLT of ten fingers may be integrated into 
a 50-dimensional feature vector, and may be condensed again through 
the KLT. Applying upper one or two dimensions thereof, the data 
amount to be treated of ten fingers may be still reduced. As for con- 
fidence value in the case, equation (25) can be applied by obtaining 
quality value q(C) from confidence vector of each finger, for example. 

Thus, by repeating the KLT for whole card data, discrimination 
performance can be still improved without increasing dimension num- 
ber of feature values. Further, treating the whole card data is especially 
effective in the case matching verification operation is finished when 
similarity distance accumulation attains to a threshold value, since dis- 
cordant card data can be rejected in earlier stage of the operation by 
treating the whole card data at the same time. 

Heretofore, the present invention is described mainly in connection 
with embodiments applied to fingerprint identification. However, it 
goes without saying that there- are many applications or modifications 
in the scope of the invention. For example, the invention can be applied 
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just the same way to the palm print identification, In the palm print, there are 
four delta parts at each finger base except the thumb, as illustrated in Fig. 21. 
Therefore, by cutting out 512 x 512 pixel data of 500 dpi of the deltas from a 
paper stamped with a palm print, they can be treated as a four fingerprint card, 
instead of the Ten Print Card. 

Each feature disclosed in this specification (which term includes the claims) 
and/or shown in the drawings may be incorporated in the invention independently 
of other disclosed and/or illustrated features. 

The text of the abstract filed herewith is repeated here as part of the 
specification: 

For providing an efficient image pattern matching system, an image feature 
extractor (11) of the invention comprises a feature vector extraction means (101) 
for extracting a feature vector from the pattern image, a quality index extraction 
means (106) for extracting quality index information of the pattern image, an error 
distribution information representing correlation between error distribution of the 
feature vector and the quality index information is prepared, and a confidence 
attribution means (108) for obtaining confidence estimation information referring 
to the error distribution information retrieved with the quality index information. 
The image feature analyzer (51) prepares the error distribution information. An 
image feature matching system identifies feature information of an image pattern 
extracted by the image feature extractor (11) by comparing it to registered feature 
information. 
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CLAIMS: 

1. A system for collating images comprising: 

means for deriving a feature value for the features of each image; 

means for deriving a quality index value for the features of each image; 

means for determining errors for the feature values in which said errors are 
adaptively measured according to the quality index of the features of each image; 
and 

means for determining the extent of ectypography between features of each 

image. 

2. A system for collating images according to claim 1, in which said means 
to determine the extent of ectypography between features of each image 
comprises: 

means for considering the confidence of the feature values between image 
features; 

means for analysing the two images by considering the confidence of the 
feature values and for referring to the errors for the feature values for the two 
image features; and 

means to refer to said errors for the feature values to determine if one 
feature is an ectype of a feature in another image. 

3. An system according to claim 1 or 2, further comprising 
an image feature extractor means; 

a index quality extraction means for extracting the quality of the index 
information of a pattern image; 

an image feature analyzer which prepares error distribution information 
representing correlation between error distribution of the feature vector and the 
quality index information; 

a confidence attribution means for obtaining confidence estimation 
information referring to the error distribution information retrieved with the quality 
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index information; and 

which identifies the feature information of an image pattern extracted by the image 
feature extractor by comparing it to registered feature information. 

4. An image feature extractor for a system according to any preceding claim, 
wherein said image feature extractor outputs a feature information data set of a 
pattern image including data of a feature vector of the pattern image and 
confidence estimation information of the feature vector attributed to each 
component of the feature vector, said image feature extractor comprising; 

a feature vector extraction means for extracting the feature vector from the 
pattern image; 

at least one quality index extraction means for extracting quality index 
information of the pattern image; 

at least one error distribution storing means, corresponding to each of said 
quality index extraction means, wherein error distribution information is prepared, 
said error distribution information representing correlation between the error 
distribution of a plurality of feature vectors and the quality index information 
corresponding to said quality feature vectors; 

a confidence attribution means, each corresponding to each of said error 
storing means for obtaining confidence information referring to said error 
distribution information; and 

a confidence estimation means for providing confidence estimation 
information. 

5. An image feature extractor according to claim 4, wherein if only one 

quality index extraction means is provided, said confidence information is output 
as said confidence estimation information; and if a plurality of quality index 
extraction means is provided, said confidence estimation information is provided 
by integrating said confidence information obtained by each of said confidence 
attribution means. 
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6. An image feature extractor for a system according to any of claims 1, 2 or 
3, for outputting a feature information data set of a pattern image including data 
of a feature vector of the pattern image and confidence estimation information of 
the feature vector attributed to each component of the feature vector, said image 
feature extractor comprising: 

a feature vector extraction means for extracting the feature vector from the 

pattern image; 

at least one quality index extraction means for extracting quality index 
information of the pattern image; 

error distribution information storing means, each corresponding to each 
of said quality index extraction means, wherein error distribution information is 
prepared, and represents the correlation between the error distribution of a plurality 
of feature vectors and the quality index information corresponding to said plurality 

of feature vectors; and 

confidence attribution means, each corresponding to each of said error 
distribution information storing means for obtaining confidence information 
referring to said error distribution information prepared in on of said error 
distribution storing means by way of said quality index information, said 
confidence information being output as the confidence estimation if only one 
quality index extraction means is provided and if a plurality of quality index 
extraction means are provided, said confidence estimation information is provided 
by integrating said confidence information obtained by each of said confidence 
attribution means. 

7. An image feature analyzer for a system according to any of claims 1 , 2 or 
3, wherein said image feature analyzer obtains error distribution information 
representing correlation between the error distribution of a plurality of feature 
vectors and the quality index information corresponding to said plurality of feature 
vectors, said image feature analyzer comprising: 

a feature vector extraction means for extracting the plurality of feature 
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vectors from pattern images; 

an index quality extraction means for extracting the quality of the index 
information of the pattern image; and 

a error distribution information analysing means for calculating the error 
distribution information from the error distributed among each feature vector set 
of the plurality of feature vectors and a value of the quality index information of 
each feature vector belonging to each feature vector set, said feature vector sets 
comprising feature vectors extracted from a plurality of pattern images of the same 
pattern. 

8. An image collating system according to claim 1, in which said means for 
determining the extent of ectypography between image features is performed using 
a feature information data set of an image pattern including a feature vector of the 
image pattern and confidence information of the feature vector attributed to each 
component of the feature vector, said image collating system further comprising: 



a database section wherein the feature information data set of each 
of a plurality of pattern images is registered; and 

a collating section to determine the degree of ec typography between the pattern 

image by discriminating accordance/discordance of the 
feature information data set of the pattern image with each of 
the feature information data set registered in said database 
section according to distance between two feature vectors each 
included in respective feature information data set calculated 
in consideration of the confidence information of the two fea- 
ture vectors. 

9. The image feature extractor recited in claim 6, said feature 
vector extraction means comprising a primary feature vector extraction 
means for extracting the feature vector of the pattern image of a skin 
pattern by extracting ridge direction information of each sub-regiorrof 
the pattern image. . . 

10. The image feature extractor recited in claim 6, said feature 
vector extraction means comprising a primary feature vector extraction 
means for extracting the feature vector from the pattern image of a 
fingerprint pattern by extracting information of distances and ridge 
line numbers between every two of singular points of the fingerprint 
pattern. 

11. The image feature extractor recited in claim 6, said feature 
vector extraction means comprising a primary feature vector extraction 
means for extracting the feature vector from the pattern image by 
sampling discrete Fourier power spectrums in a certain frequency band, 
said discrete Fourier power spectrums being obtained by performing 
discrete Fourier transfer of said pattern image. 



- 68 - 

12. The image feature extractor recited in claim 9 or claim 10, said 
feature vector extraction means further comprising at least one vector 
transfer means each transferring the feature vector making use of a 
parameter set. 

13. The image feature extractor recited in claim 12, one of said 

vector transfer means transferring the feature vector making 
use of a parameter set comprising at least one of primary principal 
component vectors of distribution of feature vectors each obtained from 
5 a data set of a plurality of pattern images in the same way with the 
feature vector. 

14. The image feature extractor recited in claim 12, one of said 
vector transfer means performing affiue transfer of the feature 
vector making use of each of a plurality of parameter set defined in a 
certain search range and outputting an affine transformation of the 
5 feature vector giving a minimum distance to a reference feature vector. 

15- The image feature extractor recited in claim n,said feature 
vector extraction means further comprising a vector transfer means for 
transferring the feature vector making use of a parameter set compris- 
ing at least one of primary principal component vectors of distribution 
5 of feature vectors each obtained from a data set of a plurality of pattern 
images in the same way with the feature vector. 

16. The image feature extractor recited in claim u.one of said at 
least one quality index extraction means extracting said quality index 
information according to said minimum distance. 

i*7. The image feature extractor recited in claim 6 ; one of said 
quality index extraction means extracting said quality index 
information according to a minimum value among distances of the 
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feature vector to a set of reference feature vectors each obtained from 
5 a high-quality pattern image in the same way with the feature vector. 

18 - The image feature extractor recited in claim 9, one of said at- 
least one quality index extraction means extracting said quality index 
information according to confidence of said ridge direction information 
of each sub-region of the pattern image. 

<ig. The image feature analyzer recited in claim 7 t: said feature 
vector extraction means extracting each of the plurality of feature vec- 
tors from each of the pattern images of sldn patterns by extracting 
ridge direction information of each sub-region of respective each of the 
5 pattern images. 

20. The image feature analyzer recited in claim j f said feature vec- 
tor extraction means extracting each of the plurality of feature vectors 
from each of the pattern images of fingerprint patterns by extracting 
information of distances and ridge line numbers between every two of 
5 singular points of respective each of the plurality of fingerprint pat- 
terns. 

21. The image feature analyzer recited in claim/ 7, said feature vec- 
tor extraction means extracting each of the plurality of feature vectors 
from each of the pattern images by sampling discrete Fourier power 
spectrurns in a certain frequency band, said discrete Fourier power 
5 spectrurns being obtained by performing discrete Fourier transfer of 
respective each of said pattern images. 

22. The image feature analyzer recited in claim 19, or claim 20, 
said feature vector extraction means further comprising at least one 
vector transfer means each transferring the plurality of feature vectors 
making use of a parameter set. 
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23. The image feature analyzer recited in claim 22 > one of said at 
least one vector transfer means transferring the plurality of feature vec- 
tors making use of a parameter set comprising at least one of primary 
principal component vectors of distribution of feature vectors each ob- 

5 tained from a data set of a plurality of pattern images in the same way 
with the plurality of the feature vector. 

2U.' The image feature analyzer recited in claim .22, one of said at 
least one vector transfer means performing affijie transfer of the plu- 
rality of feature vectors making use of each of a plurality of parameter 
set denned in a certain search range and outputting an affine trans- 

5 formation of each of the plurality of feature vectors giving a minimum 
distance to a reference feature vector. 

25. The image' feature analyzer recited in claim^ 2 1, sai d feature 
vector extraction means further comprising a vector transfer means for 
transferring the plurality of feature vectors making use of a parameter 
set comprising at least one of primary principal component vectors 

5 of distribution of feature vectors each obtained from a data set of a 
plurality of pattern images in the same way with the plurality of feature 
vectors. 

26. The image; feature analyzer recited in claim 24, said qual- 
ity index extraction means extracting said quality index information 
according to said minimum distance. 

27. The image feature analyzer recited in claim 7, said quality 
index extraction means extracting said quality index information ac- 
cording to a minimum value among distances of each of the plurality 
of feature vectors to a set of reference feature vectors each obtained 

5 from a high-quality pattern image in the same way with the plurality 



of feature vectors. 

28. 'The image feature analyzer recited in claim 19 » said qual- 
ity index extraction means extracting said quality index information 
according to confidence of said ridge direction information of each sub- 
region of said pattern images. 

29. An image feature collating systan 

making use of a feature information data set taken fran a person 
including a feature vector and confidence information of the feature, 
vector attributed to each component of the feature vector; said image 
collating system comprising a database section wherein the fea- 

ture information data set of each of a plurality of persons is registered, 
and a collating section for identifying the person by discriminating ac- 
cordance/discordance of the feature information data set of the person 
to each of feature information data sets registered in said da tabase sec- 
tion according to distance between two feature vectors each included 
in respective feature information data -set calculated in consideration 
of the confidence information of the two feature vectors, vsterein: 

said feature vector included in each of the feature information 
data set taken form the person and said feature information 
data sets prepared in said database section is obtained through 
Karhunen Loeve transfer of more than one feature vector each 
obtained through Karhunen Loeve transfer of a feature vector 
extracted from a skin pattern image of a different fixed part of 
each respective person. 
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30. A method for collating images comprising the steps of: 
determining feature values for image features; 
deriving quality index values for image features; and 

determining the extent of ectypography between each image by considering 
the confidence between the features of each image and referring to the errors for 
the feature values for the two images wherein said errors are adaptively measured 
according to the quality index of the features of the images. 

31. A method of or apparatus for collating images and determining the extent 
of ectypography between images substantially as described hereinbefore and as 
illustrated by the accompanying drawings. 




Patent 
Office 

Application No: GB 9726599.5 Examiner: John Donaldson 

Claims searched: 1 to 31 Date of search: 11 February 1998 



Patents Act 1977 

Search Report under Section 17 

Databases searched: 



UK Patent Office collections, including GB, EP, WO & US patent specifications, in: 

UK CI (Ed.P): G4R(RHB, RPF, RPX, RRL, RRM, RRP) 

• Int CI (Ed.6): A61B 5/00, 5/1 17; G06K 9/00, 9/36, 9/46, 9/48, 9/50, 9/52, 9/54, 9/60 
9/62, 9/64, 9/66, 9/68, 9/78, 9/80, 17/00; G07C 9/00 

Other: Online:WPI 



Documents considered to be relevant: 



Category 


Identity of document and relevant passage 


Relevant 
to claims 


A 


EP 0220032 A2 (PALANTIR), see abstract 





X Document indicating lack of novelty or inventive step A 
Y Document indicating lack of inventive step if combined P 
with one or more other documents of same category. 

E 

& Member of the same patent family 



Document indicating technological background and/or suit of the art. 
Document published on or after the declared priority date but before 
the tiling date of this invention. 

Patent document published on or after, but with priority date earlier 
than, the filing dale of this application. 



An Executive Agency of the Department of Trade and Industry- 



